The Digital Literacy Instructor: Developing Automatic Speech Recognition and Selecting Learning Material for Opaque and Transparent Orthographies

نویسنده

  • Catia Cucchiarini
چکیده

While learning a new language can now be a lot of fun because attractive interactive games and multimedia materials have become widely available, many of these products generally do not cater for non-literates and low-literates. In addition, their limited reading capabilities make it difficult for these learners to access language learning materials that are nowadays available for free on the web. More advanced course materials that can make learning to read and spell in a second language (L2) more enjoyable would therefore be very welcome. This article reports on such an initiative, the DigLin project, which aims at developing and testing online basic course material for non-literate L2 adult learners who learn to read and spell either in Finnish, Dutch, German or English, while interacting with the computer, which continuously provides feedback like the most determined instructor. The most innovative feature of DigLin is that in production exercises learners can read aloud and get feedback on their speech production. This is made possible through the use of Automatic Speech Recognition (ASR). In this article we focus on what ASR is and what is needed to employ ASR to develop learning materials for non-literates and low-literates L2 learners. Central issue is the selection of the content for the four languages, which differ in orthographic transparency and present their own specific problems in combination with the mother tongue of the learners.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

The digital instructor for literacy learning

The DigLIn project aims at providing concrete solutions for adult literacy students by developing and testing L2 literacy acquisition material in four different languages and by employing Automatic Speech Recognition (ASR) to analyse the learner’s read speech output and provide feedback. We develop the technology, design sample exercises for different languages (Dutch, English, German and Finni...

متن کامل

The Effect of Auditory-visu Orthographic Backgroun

Visual information from the lips and face is an integral part of speech perception. In addition, orthography can play a role in disambiguating the speech signal in foreign/second language (L2) perception and production. The current study investigates the effect of auditory and visual speech information and orthographic depth, the degree to which a language is transparent (high phoneme-grapheme ...

متن کامل

Bilingualism yields language-specific plasticity in left hemisphere's circuitry for learning to read in young children

How does bilingual exposure impact children's neural circuitry for learning to read? Theories of bilingualism suggests that exposure to two languages may yield a functional and neuroanatomical adaptation to support the learning of two languages (Klein et al., 2014). To test the hypothesis that this neural adaptation may vary as a function of structural and orthographic characteristics of biling...

متن کامل

A Database for Automatic Persian Speech Emotion Recognition: Collection, Processing and Evaluation

Abstract   Recent developments in robotics automation have motivated researchers to improve the efficiency of interactive systems by making a natural man-machine interaction. Since speech is the most popular method of communication, recognizing human emotions from speech signal becomes a challenging research topic known as Speech Emotion Recognition (SER). In this study, we propose a Persian em...

متن کامل

Designing and implementing a system for Automatic recognition of Persian letters by Lip-reading using image processing methods

For many years, speech has been the most natural and efficient means of information exchange for human beings. With the advancement of technology and the prevalence of computer usage, the design and production of speech recognition systems have been considered by researchers. Among this, lip-reading techniques encountered with many challenges for speech recognition, that one of the challenges b...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2017